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(54) Method and apparatus lor providing a seamless tiled display 



(57) A display for producing a seamless composite 
image from at least two discrete images, comprises a 
screen; projection means for projecting each of the dis- 
crete images separately onto the screen, said projection 
means projecting the discrete images such that at least 
one of the discrete images overlaps at least one adja- 
cent discrete image thereby forming at least one overlap 
region; and blending means coupled to said projection 



means for blending a selected characteristic of at least 
one of the discrete images in the at least one overlap 
region, characterised in that at least one of the discrete 
images overlaps at least one adjacent discrete image 
by more than 25 percent of that adjacent discrete image. 
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Description 

CROSS REFERENCE TO CO-PENDING 
APPLICATIONS 

[0001] The present application is related to U.S. Pat- 
ent Application Serial No. 09/158,995, filed September 
23, 1998, entitled "METHOD AND APPARATUS FOR 
CALIBRATING A TILED DISPLAY"; and U.S. Patent Ap- 
plication Serial No.09/1 59,024, filed September 23, 
1998, entitled "METHOD AND APPARATUS FOR CAL- 
IBRATING A DISPLAY USING AN ARRAY OF CAMER- 
AS", both of which are assigned to the assignee of the 
present invention and incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

[0002] This invention relates to the field of projection 
displays, and more particularly, to tiled projection dis- 
plays that use multiple projectors to produce a larger 
and/or a higher resolution image. 
[0003] Multiple projector system have been proposed 
and used for many years. In the 1950s, the "CINERA- 
MA" system was developed for the film industry. The 
CINERAMA system used three films to project three im- 
ages using three separate projectors, which were then 
combined to form a single panoramic image, Disneyland 
continues to use a similar multiple projector system, 
wherein a circle of projectors shine onto a screen that 
circles the wall of a round room. 
[0004] In the video field, multiple projector systems 
have been proposed and used for a number of specialty 
applications. U.S. Patent No. 4, 103,435 to Herndonand 
U.S. Patent No. 3,833,764 to Taylor suggest using mul- 
tiple projector systems for flight simulators. In many of 
these systems, multiple video screens are placed next 
to each other to form a large image display. A difficulty 
with many of the video based multiple projector display 
systems is that the multiple images often do not appear 
as one single continuos image on the display screen. 
When two images are projected side-by-side on a single 
screen, there is normally a seam between the images. 
The final display image will either appear as two images 
placed side-by-side with a gap therebetween or, if the 
images are made to overlap on a single screen, with a 
bright line therebetween. Because of the inconsisten- 
cies in conventional cameras, video processing and de- 
livery channels, displays and specifically projectors, it is 
exceedingly difficult to perfectly match the resultant vid- 
eo images so that no tiling artifact appears among the 
images. If the images are brought very close together 
on the same screen, there is typically both gaps and 
overlaps at each seam. 

[0005] - U. ; S. Patent r Ne.-4r974,073 to Inova suggests 
a method for producing a seamless image from multiple 
discrete images bylntehtionally Overlapping the images, 
thereby omitting the gaps, and*then reducing the bright- 
ness of the discrete images in the overlapping region of 



each mage, inova recognizes that increasing the over- 
lap reduces the size of the resulting composite image, 
and thus reduces the overall efficiency of the projection 
system. Thus, Inova appears to suggest that the overlap 

5 should be minimized. In Figure 1A of Inova, three dis- 
crete images are shown, each having an overlap of 
about 11% with the adjacent images. Because of this 
relatively small overlap, inova states that the composite 
image, which appears on the screen and is referred to 

10 as the apparent image, is almost three times as wide as 
a normal video image. To be almost three times as wide 
as the normal video image, the overlap of the images 
must be relatively small. 

[0006] Like Inova, the article entitled Design Consid- 

15 erations and Applications for In novative Display Options 
Using Projector Arrays , by Theo Mayer, SPIE Vol. 2650 
(1996), pp. 131-139, discloses projecting a number of 
discrete images in an overlapping relation and ramping 
the brightness of the discrete images in the overlapping 

20 regions of each image. Unlike Inova, Mayer also disclos- 
es using a blending function to fade down each overlap- 
ping edge of the discrete images to compensate for the 
gamma (video signal reduction vs. light output curve) of 
a phosphor, with the goal of producing uniform bright- 

25 ness across the overlap region. In all cases , Mayer 
shows an overlap of 25% or less. 
[0007] Mayer also states that to achieve a seamless 
display over a reasonable range of viewing angles, a 
screen gain of one is required (e.g. lambertian). Mayer 

30 states that screen gain is achieved by optically bending 
the light that hits the screen back toward the center of 
the screen. This is typically accomplished by narrowing 
the viewing angle of the screen and redirecting the light 
toward the viewer. Mayer states, however, that this 

35 scheme only works when the light emanates from a sin- 
gle point. 

[0008] In a tiled display, the light rays are provided 
across the screen in a complex arrangement which is 
dependent on the position of the viewer. When the po- 

^0 sition of the viewer changes, the complex arrangement 
of the light rays also changes. Mayer recognizes this for 
front projection systems, and concludes that it may be 
possible to adjust all of the colorimitry and edge blend 
parameters of the array to make a perfectly seamless 

45 and integrated image, but only at one location. Mayer 
states that if the eye point is shifted left or right from this 
calibrated location, ail the reflectivity relationships 
change and the seams again appear. To overcome this 
difficulty, Mayer states that a screen gain of one (e.g. 

50 lambertian screen profile) is required. A screen gain of 
one, by definition, diffuses the light and provides the 
same luminance in all directions. By providing the same 
luminance in all directions, the viewing angle depend- 
ence is necessarily reduced, allowing a wider viewing 

55 angle for the tiled display. , < 

[0009] Both Inova and Mayer appear to be directed 
toward front projection display systems. Front projection 
displays typically use reflective type screens, which can 
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be produced with Lambertian screen profiles (e.g. 
screen gain of one) in an efficient and cost-effective 
manner. Rear projection screens, however, cannot eas- 
ily be made with Lambertian gain profiles. 
[0010] Figure 1 and Figure 2 illustrate the passive 
gain characteristics of a typical rear projection screen. 
The gain profiles shown are relative to a uniformly scat- 
tering ideal diffuser (e.g. Lambertian screen). In the ex- 
ample screen gain profile, a ray of light having a bend 
angle of 0 degrees, will have a strength about 2.2 times 
greater than if it were to pass through a uniformly scat- 
tering, unity gain or Lambertian screen. Similarly, a ray 
with a bend angle of 45 degrees will be seen with only 
about 40% the normalized strength relative to the output 
of a Lambertian diffusion element. Significantly, this 
non-linear attribute, which many screens have, implies 
the output image of the projection system varies with 
viewing angle. Thus, images seamlessly tiled and cali- 
brated at one viewing position will have seams when 
viewed from another slightly different viewing position. 
[001 1 ] One approach for reducing the effects of a non- 
lambertian screen is to reduce the angular distribution 
of the input light that is provided to the screen. This has 
been accomplished by providing a Fresnol lens, for ex- 
ample, on or near the backside of the screen. This ap- 
proach is at least somewhat effective for display sys- 
tems that have only a single projector. However, for mul- 
tiple projector tiled display systems, this approach tends 
to enhance the visibility of the seams. That is, the Fres- 
nel lens tends to introduce discontinuities between tiles, 
which can make it more difficult to eliminate the seams 
from the display. 

[0012] What would be desirable, therefore, is a seam- 
less tiled projection system that does not require a lam- 
bertian screen, and yet provides a seamless image over 
a wider viewing angle than that of the prior art. 

SUMMARY OF THE INVENTION 

[001 3] The present invention overcomes many of the 
disadvantages of the prior art by providing a seamless 
tiled display system that does not require a lambertian 
screen, and yet provides a seamless image over a wider 
viewing angle than that of the prior art. It has been found 
that increasing the amount of overlap decreases the 
amount of seam modulation that occurs over a given 
viewing angle. Accordingly, the present invention 
achieves a seamless image by providing a larger over- 
lap than is recognized by the prior art, and more specif- 
ically, an overlap of more than 25%, and preferably an 
overlap of 50% or more. In addition, it has been found 
that by adjusting the overlap of the discrete images 
(from 0% to 50% or more) , the field of view of the number 
of projectors, the non-linear attributes of the screen, and 
the blending function, a desired seam modulation can 
be achieved over a desired viewing angle. The present 
invention may be used for both front and rear projection 
systems. 



[0014] In an illustrative embodiment, a display is pro- 
vided for producing a seamless composite image from 
at least two discrete images. The display includes a pro- 
jection means for projecting each of the discrete images 

5 separately onto a screen. The projection means projects 
the discrete images such that at least one of the discrete 
images overlaps at least one other of the discrete imag- 
es by more than 25 percent, thereby forming at least 
one overlap region. Preferably, a blending means is pro- 

10 vided for blending a selected characteristic of at least 
one of the discrete images in the at least one overlap 
region. The selected characteristic may be brightness, 
color, etc. 

[0015] In an illustrative embodiment, the projection 

75 system is a rear projection system, wherein each of the 
projectors provide an image to the rear side of a trans- 
missive screen. As indicated above, it is difficult to pro- 
duce a rear projection screen that has a lambertian gain 
profile. Thus, it is contemplated that the field-of-view of 

20 the projectors and the overlap therebetween may be ad- 
justed until the seams of the composite image are at an 
acceptable level over a predetermined viewing angle. 
This may be accomplished with an overlap of more than 
25%. In some systems, an overlap of 50% or more may 

25 be required. The 50% value, as an example value, also 
demarcates a packing arrangement which is fully redun- 
dant, leading to significant fail-operational system at- 
tributes. Fail operational means that a component can 
fail but the system continues to be fully operational. With 

30 a 50% overlap, if one projector fails, at least one more 
is ready to fill in the void. This results in significant gains 
in system reliability. 

[0016] The amount of overlap that is required to re- 
duce the seams of the composite image to an accepta- 

35 ble level over a predetermined viewing angle may de- 
pends on a number of factors including the field-of view 
and aperture size of each of the projection means, the 
screen gain profile, the blending function used, etc. To 
reduce the overlap that is required, it is contemplated 

40 that the field-of view of the projection means may be 
reduced. By reducing the field-of-view of the projection 
means, the angular distribution of the light input provid- 
ed to the screen is reduced, and the shift variance of the 
output image is reduced as described above. 

45 [001 7] To help reduce the field of view of the projection 
means, it is contemplated that one or more lenses may 
be provided adjacent selected projectors. The lenses 
are preferably spaced from the screen so that the imag- 
es produced by adjacent projectors are allowed to over- 

so lap on the screen. A small blending region then provides 
a gradual transition from one tile to the next. 

BRIEF DESCRIPTION OF THE DRAWINGS 

55 [0018] Other objects of the present invention and 
many of the attendant advantages of the present inven- 
tion will be readily appreciated as the same becomes 
better understood by reference to the following detailed 
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description when considered in connection with the ac- 
companying drawings, in which like reference numerals 
designate like parts throughout the figures thereof and 
wherein: 

Figure 1 and Figure 2 are diagrams showing the 
passive gain characteristics of a typical rear projec- 
tion screen; 

Figure 3 shows an illustrative projector for use in 
the present invention; 

Figure 4 shows a four-by-six array of the projectors 
of Figure 3; 

Figure 5 is a schematic diagram of a display with 
four projectors, wherein each projector projects an 
image that overlaps the adjacent images by more 
than 25%; 

Figure 6 is a schematic diagram of a display with 
four projectors, wherein each projector projects an 
image that overlaps the adjacent images by about 
50%; 

Figure 7 is a plot of an illustrative blending function 
for use in conjunction with a display having an over- 
lap of 50%; 

Figure 8 is a chart showing luminescence modula- 
tion as a function of screen overlap; 
Figure 9 is a schematic diagram showing the an- 
gular distribution of light rays at the screen using 
projectors having a 15 degree field-of view, and ze- 
ro percent overlap of the images; 
Figure 10 is a schematic diagram showing the an- 
gular distribution of light rays at the screen using 
projectors having a 15 degree field-of view, and 50 
percent overlap of the images; 
Figure 11 is a. schematic diagram showing the an- 
gular distribution of light rays at the screen using 
projectors having a 30 degree field-of -view, and ze- 
ro percent overlap of the images; 
Figure 12 is a schematic diagram showing the an- 
gular distribution of light rays at the screen using 
projectors having a 30 degree field-of view, and 50 
percent overlap of the images; 
Figure 13 is a schematic diagram showing a pro- 
jector system having an aperture and a lens to re- 
duce the angular variation in the light input that is 
provided to the screen; 

Figure 14 is a schematic diagram showing a pro- 
jector system similar to Figure 13, with a second 
lens in lieu of, or adjacent to, the aperture of Figure 
13; 

Figure 15 is a schematic diagram showing a pro- 
jector system similar to Figure 13 that uses a re- 
flective system to shorten the distance between the 
aperture and the screen; and 
Figure 16 is a schematic diagram showing a seam 
optimization apparatus and method in accordance 
with the present invention. 



DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0019] The present invention provides a seamless 
tiled projection system that does not require a lamber- 
tian screen, and yet is capable of providing a seamless 
image over a wider viewing angle than that of the prior 
art. It has been found that increasing the amount of over- 
lap decreases the amount of seam modulation that oc- 
curs over a given viewing range. Accordingly, the 
present invention contemplates providing a larger over- 
lap than is recognized by the prior art, and more specif- 
ically, an overlap of more than 25%. By providing an 
overlap of more than 25%, and preferably about 50% or 
more, the seams in the composite image may be re- 
duced over a wider viewing angle. In addition, it has 
been found that by adjusting the overlap of the discrete 
images (from 0% to 50% or more), the field of view of 
the number of projectors, the non-linear attributes of the 
screen, and the blending function, a desired seam mod- 
ulation can be achieved over a desired viewing angle. 
[0020] In accordance with in illustrative embodiment 
of the present invention, a number of projectors are tiled 
together into an array. Each projector projects an image 
onto a screen. By properly selecting the field-of view and 
spacing of the projectors, the images at the screen can 
be overlapped by more than 25%. Further, by increasing 
the field-of view of the projectors, and/or reducing the 
spacing between projectors, the images at the screen 
can be overlapped by about 50% or more. 
[0021] An illustrative projector of the present invention 
is shown in Figure 3. The projector is generally shown 
at 8, and uses one Digital Micromirror Device (DMD) 10. 
DMD devices typically include an array of electronically 
addressable, movable square mirrors that can be elec- 
tro-statically deflected to reflect light. The use of a DMD 
device can provide a lightweight, reliable, digital display 
with a wide viewing angle and good picture clarity. Some 
DMD devices meet various M1L-STD-810 environmen- 
tal and stress requirements, and can display color 
graphic, text and video data at various frame rates. 
[0022] The projector 8 also may include various opti- 
cal elements to properly prepare the incoming illumina- 
tions to illuminate the DMD 1 0, and project the outgoing 
image. As shown in Figure 3, the optical path may in- 
cludes two segments including the illumination path 12 
and the projection path 14. The illumination path starts 
with a high-reliability, metal haiide, short-arc lamp 16 
that illuminates the DMD 10. The light from the arc lamp 
1 6 passes into a rotating RGB color filter wheel 1 8. An 
illumination relay lens magnifies the beam to illuminate 
the DMD 1 0 and form a telecentric image at the DMD 
10. A Total Internal Reflection (TIR) prism enables the 
incoming light from the lamp to pass onto the DMD 1 0, 
and back into the projection optics. Depending on the 
rotational state of the mirror (e.g. ±10 degrees for on/ 
off), the light from the DMD 10 is directed into the pupil 
of the projection lens (on) or away from the pupil of the 
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projection lens (off). A multiple-element projection cell 
magnifies the image coming off the DMD 1 0, at the de- 
sired MTR lateral color and distortion. 
[0023] Each projector 8 also preferably includes an 
electronics module (not explicitly shown in Figure 3). 
The electronics module may take the incoming data sig- 
nals, convert the temporal signals into spatial represen- 
tations on the DMD 1 0, and control the filter 1 8 that pro- 
vides the sequential color for the display. Preferably, the 
electronics are modular allowing an arbitrary number of 
projectors to be tiled together without significant modi- 
fications to the electronics. Further tiling algorithms may 
be incorporated into the electronics, as appropriate, to 
enable "smart" projectors. This may allow the electron- 
ics of each projector to automatically or manually adapt 
to an arbitrary configuration of projectors. 
[0024] Figure 4 shows a four-by-six array of projec- 
tors. In one embodiment, the processing electronics is 
packaged between the individual projectors. In another 
embodiment, the processing electronics is packaged in 
a rack-type chassis. A further discussion of illustrative 
processing electronics and the operation thereof may 
be found in U.S. Patent Application Serial No. 
09/158,995, filed September 23, 1998, entitled 
" METHOD AND APPARATUS FOR CALIBRATING A 
TILED DISPLAY"; and U.S. Patent Application Serial 
No. 09/159,024, filed September 23, 1998, entitled 
"METHOD AND APPARATUS FOR CALIBRATING A 
DISPLAY USING AN ARRAY OF CAMERAS". 
[0025] Figure 5 is a schematic diagram of a display 
50 having four projectors 52, 54, 56 and 58. Each of the 
projectors projects a discrete image onto screen 62. The 
size of each image on the screen depends on the field- 
of-view of the projectors, and the distance between the 
projectors and the screen 62. In the illustrative embod- 
iment, each of the projectors has a field of view of 9, as 
shown at 64, which produces an image size as shown 
at 68. 

[0026] Preferably, the field-of view is adjusted to 
achieve a desired image size. Thereafter, and in accord- 
ance with the present invention, each of the projectors 
are spaced from one another so that the discrete images 
on the screen overlap by more than 25%. As shown in 
Figure 5, the light spray pattern 60b from projector 54 
overlaps the light spray pattern 60a from projector 52 by 
more than 25%, as shown at 72. Likewise, the light spray 
pattern 60b from projector 54 overlaps the light spray 
pattern 60c from projector 56 by more than 25%, as 
shown at 70. By providing an overlap of more than 25%, 
the present invention provides an improved seamless 
tiled projection system that does not require a lamber- 
tian screen, and yet still provides a seamless image over 
a wider viewing angle than that of the prior art. 
[0027] It is contemplated that the overlap may be larg- 
er in one direction relative to another direction. For ex- 
ample, a display having a substantial overlap in the hor- 
izontal direction may have little or no overlap in the ver- 
tical direction. This would be useful for a user whose 



height does not vary much, such as a person sitting at 
a desk. Likewise, in a fighter cockpit application, the 
field-of-view of the viewer may be narrowed to a small 
headbox of +-3 inches horizontally and about +-1/2 ver- 
5 tically. This narrow viewer field-of view means that less 
overlap may be acceptable while still maintaining a 
seamless look for the pilot. 

[0028] The information in the video signals corre- 
sponding to the overlap regions 70 and 72, is duplicated 

10 in the video signals for the three images provided by pro- 
jectors 52, 54 and 56. That is, for overlap 72, the right 
portion of the image projected by projector 52 must be 
virtually identical to the left portion of the image project- 
ed by projector54. Otherwise, neither of the overlapping 

15 portions of the images will appear clearly on the screen. 
[0029] It is contemplated that a blending block may 
be provided for each projector, or alternatively, a blend- 
ing block may be provided for all of the projectors. In the 
illustrative embodiment, each projector has a corre- 

20 sponding blending block. For example, projector 52 has 
blending block 74, projector 54 has blending block 76, 
projector 56 has blending block 78, and projector 58 has 
blending block 80. Each of the blending blocks blend a 
selected characteristic of at least one of the discrete im- 

25 ages in the corresponding overlap region. For example, 
blending block 74 may apply a blending function to the 
video signal 82 to blend a selected characteristic of the 
image provided by projector 52 in the overlap region 72. 
Likewise, blending block 76 may apply a blending func- 

30 tion to the video signal 83 to blend a selected charac- 
teristic of the image provided by projector 54 in the over- 
lap region 72. The selected characteristic may be bright- 
ness, color, etc. The blending function may be similar to 
that described in U.S. Patent No. 4,974,073 to Inova 

35 and/or U.S. Patent No. 5 ; 668,569 to Greene et al. 

[0030] Figure 6 is similar to Figure 5 but includes 
about a 50% overlap of adjacent images. As indicated 
above, the amount of overlap that is required to reduce 
the visibility of the seams of the composite image to an 

40 acceptable level over a predetermined viewing angle 
depends on a number of factors including the field-of- 
view and aperture size of each of the projectors, the 
screen gain profile, etc. In an illustrative embodiment, 
the projection system is a rear projection system, where- 
as in each of the projectors provides an image to the rear 
side of a transmissive screen. It is often difficult and/or 
expensive to produce a rear projection screen that has 
a lambertian gain profile. Thus, it is contemplated that 
both the field-of view of the projectors and the spacing 

so between projectors can be adjusted until the seams of 
the composite image are at an acceptable level over a 
predetermined viewing angle. In some systems, this 
may require an overlap of about 50% or more. As shown 
in Figure 6, the light ray spray pattern 110b from pro- 

55 jector 1 04 overlaps the light spray pattern 1 1 0a from pro- 
jector 102 by about 50%, as shown at 118. Likewise, the 
light ray spray pattern 1 1 0b from projector 1 04 overlaps 
the light spray pattern 1 1 0c from projector 1 06 by about 
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50%, as shown at 116. 

[0031 ] The 50% value, as an example value, also de- 
marcates a packing arrangement which is fully redun- 
dant, leading to significant fail-operational system at- 
tributes. Fail operational means that a component can 
fail but the system continues to be fully operational. In 
this case, if one projector were to fail, at least one more 
is ready to fill in the void. This implies significant gains 
in system reliability. The gain in reliability may be derived 
from the fact that for a portion of the image projected on 
the screen to be absent of information, the total proba- 
bility of failure is now the ANDing of the probabilities of 
failure of several redundant channels. Therefore, using 
the overlap principle, perhaps in combination with small 
field of view projectors : the viewing angle variance of 
many non-Lambertian screens can be attenuated suffi- 
ciently for seamless tiling applications. 
[0032] In a preferred embodiment, the blending func- 
tion performed by blending blocks 122, 124, 126 and 
128 is similar to that shown in Figure 7. Figure 7 shows 
a two-dimensional linear ramp blending function. The 
two-dimensional linear ramp blending function of the il- 
lustrative embodiment extends to the center 1 50 of the 
image to compensate for the 50% overlap of the images. 
It is contemplated that the blending function may also 
be a spline, trigonometric, polynomial cosine 2 or any 
other type of function. 

[0033] Figure 8 is a chart showing luminescence as 
a function of screen overlap when viewed 20 degrees 
off the axis of compensation. A line representing the 
modulation of a display having zero percent overlap is 
shown at 182. This line shows a striking saw-tooth pat- 
tern, which the eye can readily detect as salient seams. 
It may be possible to adjust all of the brightness, color- 
imitry and edge blend parameters of the array to make 
a perfectly seamless and integrated image, at one loca- 
tion. However, and because the screen is assumed to 
be non-Lambertian, if the viewing position is shifted left 
or right the seams again become evident. In accordance 
with the present invention, however, by increasing the 
overlap, the amount of modulation decreases for a given 
off-axis viewing angle. Referring to Figure 8, lines rep- 
resenting the modulation of 10, 20, 30, 40, and 50 per- 
cent overlap are shown at 184, 186, 188, 190, and 192, 
respectively. As is evident, these lines become progres- 
sively more linear as the amount of overlap is increased. 
[0034] Accordingly, the present invention contem- 
plates providing a larger overlap than is recognized by 
the prior art, and more specifically, an overlap of more 
than 25%, and more preferably about 50% or more. As 
indicated in Figure 8, overlaps of less than 25% permit 
extensive seam artifacts to emerge. By providing an 
overlap of more than 25%, the seams in the composite 
image may be reduced over a wider viewing angle. 
[0035] Figure 9 is a schematic diagram showing the 
angular distribution of light rays at a non-lambertian 
screen 224 using projectors 220a and 220b, each hav- 
ing a 15 degree field-of-view, and collectively providing 



zero percent overlap of the corresponding images. 
While each projector 220a and 220b is simply illustrated 
as a projection lens, it is understood that other compo- 
nents are also included including a light source, etc. 

5 [0036] The first projector 220a projects a light spray 
pattern with a field of view represented by G 222a. The 
light rays that strike normal to the surface of the screen 
224 produce an elliptical light distribution pattern, as 
shown at 226a. The elliptical light distribution pattern is 

10 caused by the passive gain characteristics of the 
screen. A lambertian screen (e.g. one having a gain of 
one) would provide a light distribution pattern that re- 
sembles a half-sphere, indicating that the same lumi- 
nance is produced in all directions. Illustrative passive 

15 gain characteristics of non-Lambertian screens are 
shown and described with reference to Figure 1 and 
Figure 2. The light rays that strike the screen 224 about 
7.5 degrees off-axis produce an elliptical light distribu- 
tion pattern that is tilted by about 7.5 degrees relative to 

20 the screen, as shown at 228a. 

[0037] Likewise, the second projector 220b projects 
a light spray pattern with a field of view represented by 
0 222b. The light rays that strike normal to the surface 
of the screen 224 produce an elliptical light distribution 

25 pattern, as shown at 226b. The light rays that strike the 
screen 224 about -7.5 degrees off-axis produce an el- 
liptical light distribution pattern that is tilted by about -7.5 
degrees relative to the screen, as shown at 228b. Both 
projectors 220a and 220b project light rays that strike 

30 ±15 degrees off-axis, respectively. These light rays in- 
tersect to produce an egg-shaped light distribution pat- 
tern, as shown at 230. 

[0038] It is possible to adjust all of the coiorimitry and 
edge blend parameters of the array to make a perfectly 
35 seamless and integrated image. However, because the 
light distribution patterns are non-symmetrical, if the 
viewing location is shifted left or right, the seams again 
become evident. 

[0039] Figure 10 is a schematic diagram showing the 
40 angular distribution of light rays at the screen using pro- 
jectors having a 15-degree field-of view, and 50 percent 
overlap of the images. With 50 percent overlap, each of 
the light distribution patterns is relatively symmetrical 
with respect to the screen and to each other. Thus, it is 
45 possible to adjust all of the luminescence, coiorimitry 
and edge blend parameters of the array to make a 
seamless and integrated image overa widerviewing an- 
gle. 

[0040] Figure 1 1 is a schematic diagram showing the 
so angular distribution of light rays at the screen using pro- 
jectors having a 30 degree field-of view, and zero per- 
cent overlap of the images. When the field-of view of the 
projectors is increased, the amount that the correspond- 
ing light distribution patterns become tilted relative to the 
55 screen tends to increase. For example, the elliptical light 
distribution patterns 288a and 288b are tilted about ±15 
degrees relative to the screen, rather than only 7.5 de- 
grees. Further, the intersection of the light rays from both 
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projectors 280a and 280b produce a heart shaped light 
distribution pattern, as shown at 290. Because the light 
distribution patterns are even more non-symmetrical 
than that shown in Figure 9, a smaller shift in the viewing 
position can reveal the seams. 

[0041 ] Figure 1 2 is a schematic diagram showing the 
angular distribution of light rays at the screen using pro- 
jectors having a 30 -degree field-of -view, and 50 percent 
overlap of the images. As can be seen, with 50 percent 
overlap, each of the light distribution patterns is more 
symmetrical than with zero percent overlap. Thus, it is 
possible to adjust all of the luminescence, colorimitry 
and edge blend parameters of the array to make a 
seamless and integrated image over a wider viewing an- 
gle. However, it is also recognized that using a projector 
with a smaller field-of-view can increase the viewing an- 
gle that can be accommodated while still maintaining an 
apparent seamless image. 

[0042] Figure 13 is a schematic diagram showing a 
projector system having an aperture and a lens to re- 
duce the angular variation in the light input that is pro- 
vided to the screen. As indicated above, the amount of 
overlap that is required to reduce the seams of the com- 
posite image to an acceptable level over a predeter- 
mined viewing angle depends on a number of factors 
including the field-of-view and aperture size of each of 
the projectors, the screen gain profiie, the blending func- 
tion used, etc. To reduce the overlap that is required, it 
is contemplated that the field-of view of the projectors 
may be reduced. By reducing the field-of view of the pro- 
jectors, the angular distribution of the light input provid- 
ed to the screen is reduced, and the shift variance of the 
output image is reduced, as described above. 
[0043] To help reduce the field of view of the projec- 
tors, one or more lenses 350a and 350b may be provid- 
ed adjacent each projector. The lenses 350a and 350b 
are preferably sufficiently spaced from the screen 352 
so that the images produced by adjacent projectors are 
allowed to overlap on the screen 352. It is contemplated 
that the lenses may be Fresnel lenses, and may be po- 
sitioned to not correspond to the image or object focal 
planes. Positioning the Fresnel lenses here has the ben- 
efit of reducing the impact of the granularity and struc- 
ture of the lenses. It is also contemplated that a sheet 
of Fresnel lenses may be suspended between the pro- 
jector and the screen, and preferably pulled taut midway 
or so between the projector and the screen. 
[0044] A small overlap region 354 between adjacent 
discrete images is preferably provided. The small over- 
lap region 354 is preferably more than just a few pixels 
(e.g. > 5 pixels). A blending function may then be used 
to gradually transition from one tile to the next, as de- 
scribed above. 

[0045] It is contemplated that an aperture 360a may 
be provided between the lens 350a and the correspond- 
ing projector, as shown. Likewise, an aperture 360b may 
be provided between the lens 350b and the correspond- 
ing projector. The lenses 350a and 350b receive the light 



rays through the apertures 360a and 360b, and direct 
the light relatively uniformly toward the screen. Prefer- 
ably., the field-of-view of each lens 350a and 350b is 
greater than zero, and the spacing of the lenses is such 

5 that an overlap 354 is provided between adjacent imag- 
es. However, it is recognized that the field-of-view may 
be made small enough so that little or no overlap may 
be required to achieve a seam modulation of less than 
one Just-Noticeable-Difference (JND). For example, it 

10 has been found that by providing a field-of-view of about 
3 degrees in combination with a Jenmar screen, a seam 
modulation of less than one JND was produced. Thus, 
by properly selecting the field-of view of the projection 
system, the screen gain, and other parameters, the de- 

15 sired seam modulation may be achieved over a desired 
viewing angle. 

[0046] Figure 14 is a schematic diagram showing a 
projector system similar to Figure 1 3, with a second lens 
in lieu of, or adjacent to, the aperture of Figure 13. By 

20 providing a second lens 370a, the distance that is re- 
quired between the projector and the screen is reduced, 
while still allowing a selected degree of seam modula- 
tion. Figure 15 shows that reflective or catadioptric sys- 
tems may also be used to help reduce the distance be- 

25 tween the projectors and the screen. 

[0047] Another factor that contributes to the perform- 
ance of the system is vignetting. If the Fresnel lenses 
are sized so that they vignette appropriately, the projec- 
tors can be placed closer together. This means that it is 

30 possible to have smaller field-of views and larger over- 
laps than could be achieved if there was no vignetting. 
In addition to allowing greater overlap, the vignetting 
tends to reduce the amount of light reaching the edges 
of the displays. By properly designing the optics, and in 

35 particular the Fresnel lenses, the vignetting may provide 
a built in blending function between tiles. 
[0048] All of the above embodiments are examples of 
implementations that may be produced by the seam op- 
timization apparatus and method 500 shown in Figure 

40 16. The seam optimization system 500 comprises an 
optimization module 401 as its central element. The op- 
timization module may include a processor that is pro- 
grammed to perform an embedded optimization algo- 
rithm. The processor may be implemented using a DSP, 

45 FPGAs, ASICs, a general-purpose processor, a PC ei- 
ther separately or in combination as appropriate for 
each application. 

[0049] The optimization algorithm may be implement- 
ed as a least square error routine, a Levinson-Marquardt 

50 error reduction routine, a genetic algorithm optimization 
search method, a fuzzy control algorithm, a neural net- 
work null seeking algorithm, a cognitive map method or 
any other control algorithm for optimizing and controlling 
the system. The optimization algorithm may further be 

55 embodied in a realtime or non-realtime implementation. 
[0050] The optimization module 401 preferably reduc- 
es the output JND measure or equivalent error metric to 
a value of less than epsilon, where epsilon is the allow- 
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able final error. In general, the optimi7ation module 401 
models the output of each stage in the seamless tiling 
system to produce a modulation function of the seams 
as the human eye would see them. This is typically done 
for flat field images applied to the system. 
[0051] The modulation function may be modeled on 
a ray by ray basis resulting in a Seam Modulation Profile 
jth element 416 which may be a portion of the overall 
global profile of the seam produced by the system 500. 
The global profile of the seam is defined as the function 
seen over the entire display. The optimization module 
401 may output Overlap Pitch 402 and Overlap Size403 
either incrementally or continually in a dynamic feed- 
back loop. - 

[0052] The Overlap Pitch 402 and the Overlap Size 
403 affix the span of the Blending Function 404, which 
as noted elsewhere herein, may be implemented as a 
ramp, a spline, a trigonometric, a polynomial or some 
other equivalent blending function. The Blending Func- 
tion 404 may include the composite effects of the math- 
ematical blending function, as well as other system el- 
ements such as the Projection Lens 409, the Depth Re- 
ducer 411 , etc. The primary purpose of the composite 
blending function 404 is to alter the amplitude of each 
Light Ray 408 in a deliberate manner so as to effect the 
reduction of seam error to less than one epsilon. The 
blending function 404 is preferably applied to the digital 
or analog image, which maybe provided by a DMD, LCD 
or similar device. 

[0053] The projection lens 409 may alter the direction 
of a ray to produce a new Ray angle 41 0, which may be 
a wide or narrow field of view (FOV). The new Ray angle 
410 is then transmitted through a Depth Reducer com- 
ponent 411. The Depth Reducer component 411 may 
be implemented as a lens, a Fresnel lens 350a, a folding 
optical element as shown for example in Figure 1 5, etc. 
The Depth Reducer 411 may alter the Ray Angle k 410 
to produce image element Ray Angle "m" 41 2. As noted 
above, the Ray Angle "m" 41 2, in combination with View- 
ing Angle "p" 407, produces Bend Angle "n M 413 which 
determines substantially how the screen gain will be ap- 
plied to the ray amplitude. 

[0054] The optimization system 500 may also com- 
prise a Viewing Box 406. The Viewing Box 406 helps 
define the cycles per degree subtended by the resultant 
seam modulation function. The geometry of the viewing 
box in relation to the screen defines the degrees of free- 
dom and the range the eye reference point is allowed to 
move as a function of each application. The Viewing Box 
406 preferably provides both the distance to the display 
and also the range of Viewing Angles 407 that may be 
accommodated by the application. Together with the 
Ray Angle "m" 412, the Viewing Angle "p" 407 defines 
the Bend Angle V 41 3 that will be applied to the screen 
which has a Screen Gain 414 (which is known to be a 
function of the bend angle 41 7). 

[0055] The Screen Gain 41 4 may result in a Light Ray 
Luminance Output 415 which has angular and ampli- 



tude attributes that are visible to the viewer whose view 
may span the viewing box 406, which may be a complex 
geometrical volume for one to many viewers. The 
Screen Gain may be that of a front or rear projection 
5 screen. The resultant output, Light Ray "J" Luminance 
Out 41 5 is tallied in Seam Modulation Profile jth element 

416. Seam Modulation Profile jth element 416 is inte- 
grated into differential elements in the optimization sys- 
tem to calculate the global Seam Modulation Profile as 

10 seen over the entire display and over the range of ail 
viewing angles in the Viewing Box, 406. The Seam Mod- 
ulation Profile jth element 41 6 may be converted into a 
spatial frequency profile for calculation of JND or equiv- 
alent perceptual value, thereby resulting in a feedback 

15 element to the Optimization Module 401 . 

[0056] The error metric of the optimization system 500 
may include a Contrast Threshold Function (CTF) block 

417. The CTF block 417 may be optimized for the hu- 
man vision system. For example, the allowable error as 

so indicated by the allowable seam 400 may be a function 
of spatial frequency. More modulation is typically al- 
lowed at spatial frequencies higher and lowerthan about 
6 cycles per degree, which is the point of optimal human 
vision sensitivity. The error function may be expressed 

25 in terms of the spatial frequency domain by using a Fou- 
rier Transform, a Discrete Cosine Transform, a Wavelet 
Transform, a Cepstrum or any other suitable frequency 
transform. The output of the CTF block 41 7 is preferably 
a JND or equivalent perceptual metric of the modulation 

30 amplitude of the seam . This may be expressed as a JND 
value per degree of view angle or as a JND output as a 
function of x and y which span the viewing area of the 
display or an equivalent geometric description of the 
seam modulation values. 

35 [0057] The Optimization Module 401 may then pro- 
duce an error function by subtracting (or equivalent op- 
eration) the Allowable Seam 400 from the Output JNDs 
feedback element 418, and may make system adjust- 
ments to reduce the resulting difference to null. For ex- 

40 ample, the Optimization Module 401 may produce a 
Blending Function coefficient adjustment for the Blend- 
ing Function 404 so as to more effectively null the error 
to zero. 

[0058] The aforementioned embodiments are merely 
45 illustrative examples of a system in accordance with the 
present invention. For a small headbox, like a fighter 
cockpit application in which the head of the user may 
actually be tied by straps to a small view volume, an 
overlap of a 3% with a Depth Reducer having no effect 
50 on the ray angle and using a Jenmar screen may result 
in a seamless system. For a control room application in 
which many viewers may be spread over a large area 
and a Jenmar screen is used and no Depth Reducer is 
used, then a 50% overlap may be required. For an ap- 
55 plication in which depth is significant and the overlap 
must be held to greater than or equal to 5% for error 
distribution reasons, and must be held to 5% for cost 
reasons, then a Depth Reducer must typically be ap- 
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plied to achieve the seamless value as determined by 
a spatial frequency optimization routine. 
[0059] Having thus described the preferred embodi- 
ments of the present invention, those of skill in the art 
will readily appreciate that the teachings found herein 
may be applied to yet other embodiments within the 
scope of the claims hereto attached. 



16 

7. A method for producing a seamless composite im- 
age from at least two discrete images, the method 
comprising the steps of: 

projecting the at least two discrete images sep- 
arately onto a screen such that at least one dis- 
crete image overtaps at least one adjacent dis- 
crete image by more than 25 percent of that ad- 
jacent discrete image, thereby forming at least 
one overlap region (70, 72); and 
blending a selected characteristic of at least 
one of the discrete images in the at least one 
overlap region. 



Claims 10 

1 . A display (50) for producing a seamless composite 
image from at least two discrete images, compris- 
ing: 

15 

a screen (62) ; 

projection means (52, 54, 56, 58) for projecting 
each of the discrete images separately onto the 
screen, said projection means projecting the 
discrete images such that at least one of the 20 
discrete images overlaps at least one adjacent 
discrete image thereby forming at least one 
overlap region (70, 72); and 
blending means (74, 76, 78, 80) coupled to said 
projection means for blending a selected char- 25 
acteristic of at least one of the discrete images 
in the at least one overlap region, 

characterised in that at least one of the dis- 
crete images overlaps at least one adjacent dis- 30 
crete image by more than 25 percent of that adja- 
cent discrete image. 

2. A display according to claim 1 , wherein at least one 

of the* discrete images overlaps at least one adja- 35 
cent discrete image by 50 percent or more of that 
adjacent discrete image. 

3. A display according to claim 1 or claim 2, wherein 

the projection means comprises at least two projec- 40 
tors for projecting at least two discrete images sep- 
arately onto the screen. 

4. . A display according to claim 3, wherein each of the 

at least two projectors receives a discrete video sig- *s 
nal that corresponds to one of the at least two dis- 
crete images. 

5. A display according to any preceding claim, wherein 

the screen is a non-Lambertian screen. so 

6. A display according to claim 1 , wherein the at least 
one discrete image overlaps the at least one adja- 
cent discrete image in a first direction, and the at 
least one of discrete image also overlaps at least 55 
one other adjacent discrete image in a second di- 
rection, the overlap in the first direction being differ- 
ent from the overlap in the second direction. 
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